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MAIL IMAGE PROFILING AND HANDWRITING I4ATCHING 



CROSS REFERENCE TO RELATED APPLICATIONS 

(0001] This application claims priority of u. S. 
Provisional Application 60/422,311 filed on October 30, 2002, 
which is herein incorporated by reference. 



BACKGROUND OF THE INVENTION 



10002] This invei 
of hazardous material am 



relates generally to the detection 
e particularly, to the application 
of image processing to early detection of potentially hazardous 
material, associated with mail collection or the collection of 
other objects. 

[0003] Recently there has been increased awareness of 
the potential for large-scale introduction of hazardous 
materials, for example, biological organisms, to create chaos or 
to harm an intended set of victims. One potential delivery 
method that terrorists or other criminals utilize to deliver 
such hazardous materials is through the mail or other form of a 
delivery. In so doing, not only is damage incurred by the 
intended victims, but also by any set of potential victims that 
may be in a position of handling such objects as the mail during 
the delivery or distribution process. 

10004] There is currently technology available to law 
enforcement organizations for detecting the presence of chemical 
and biological threats. Such test materials generally are 
sensitive to specific hazardous materials and are utilized by 
directly putting them in contact with such hazardous materials. 
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■Table li Detectable Image Characteristics List 

I cinat: n ddrs - soiotion " " """ 

"Barcodes ~7fim~, Pi.i < _? . , , , . T^odim^StT 

Enveiope~Size 

D r; s 1 i na t Id'n /H^TZTTlui d r c s - : ; "' S vie"" 

CI ear" Area Irif ringiment ' 

Destination Address Infringement 

Stain 

i o j- > r t - ,t ' 

Type 

Excessive Postage 

: J 3 s t r i alive Markings" " "' " 

Return address Resolution (including "miss pel lings) 
'En- .'t 1 :■ p W >lili\lct s= r i s t :cs : ' ' '• ■ ■■■■ ~~ 

Handwriting Similarity — 



Mail piece characteristics requiring more sophisticated 
algorithms for detection are grouped into later phases for 
deployment 

'[(HOT I' " ' Exemplary, but not 'limited to, image-detectable 
Mlt fi'ece li a n i' • - addressing degrees" of' eifeVtiver.es's 
and accuracy, development time, image type, and relative 
processing power required, as described herein below. 

[0038j Handwriting Matching, the capability to analyze 
handwriting or hand-printing on mail images to determine 
similarity to that of other (euLdence) documents, is potentially 

! I 
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* Excessive Foatage - The following embodiments , bat not 

limited to, can distinguish instances of probable excessive 
postage. An assessment of the extent and shape of the 
postage area may be obtained froa linage processing of the 
binary (bi -tonal) images. Combined with the neural net 
technology described above for determining Postage Type, 
this Diethod could assess the probability of presence of 
multiple stamps. The result is a probabilistic indication, 
of excessive postage. 
A more precise determination of the postage amount on an 
envelope requires processing grayscale images in order to 
recognize in detail specific stamp images and their amounts. 

8) Restrictive Markings - The possible presence of restrictive 
text such as the words "Personal* or "Confidential" may be 
detected by means of image character recognition. In some 
embodiments, the image processing could be performed at the 
remote image reading and processing system (RCR) 2. For 
handwritten marks, the detection would require handwriting 
analysis, and may be more appropriately performed offline. For 
.. Biachill<3 . f ir . i ?. te . c ? .«**•?: e. optical. . character, reeo.gni.tion. results, 
usually obtained at the remote image reading and processing 
systera (RCK) 2, enable searching, machine . printed text for 
keywords . 

9) Clear Zone Infringements - Several embodiments, but not 
limited to, of methods for detecting Clear 2one Infringements 
are disclosed below. Referring to Figures 2 and 5, the bottom 
band of envelope images seen by the remote image reading and 
processing system (RCR) 2 is normally clear, as this is the area 
in which a (ZOSTXH?, Uu.co«i« 90 is printed after the remote 
image reading and processing (and video coding if applicable) is 
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Charactsiis'iiic"" Categories 

Stylo HandwHtter 
(any form) 



5) Return 
Address 
Resolution 



Image Detection Accuracy" 
Type Rate 



Hand printer 



Machine 
printed iany 



solid 
■ Machine 

Machine dot- 



Invalid 
Directory ) 



• ' Invalid 

address ( 0W 
Directory) 



N'or.-ic~d I. 
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Characteristic 



Postal Code 
(Zip) Match 
(against a 
list of 
ZIPS) 



Xasago Detection Accuracy 
Type I Rate 



! Low {HW)~ 
. I 5 digits 
j Moderate 



Envelope 



?ostage Type Cray 



8) Restrict!* 
Mai-kings 



9) Clear Area 
Infringement 



Ex;;.;:;:,.: vo ai Macerate; " "Moderate 

Postage Tonal 



Address 
Infringement 



(KW)" , Koderc 
High 



Gray \ Moderate ! Low 
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Charscteriitl Categoric: 



Type 



| Detection 
' Kate 



I similarit; 



a of image required to support detection of 



Bi- Current bi-tonal images of t 

tonal i envelope are usable 

Gray: Grayscale images required 

Color: Color images required 



Ogtectior. Hate: An- estimate of the frequency of false ' 
negatives ~ instances where a mail piece exhibits the 
characteristic but the system fails to detect and indicate 



Low op to 25% false negatives 

Moderate Op to 15% false negatives 

Ki 9" Up to 5% false negatives 

Vary High Approximately 1% - 2i false 

negatives 
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